Multimodal Interaction in a Haptic Environment

In this paper we investigate the introduction of haptics in a multimodal tutoring environment. In this environment a haptic device is used to control a virtual piece of sterile cotton and a virtual injection needle. Speech input and output is provided to interact with a virtual tutor, available as a talking head, and a virtual patient. We introduce the haptic tasks and how different agents in the multi-agent system are made responsible for them. Notes are provided about the way we introduce an affective model in the tutor agent

Haptic Water; Haptics on an Animated Surface

Haptic rendering is becoming an important element of multimodal interaction. Often a real-time coupling between haptics and visualization is required, based upon an underlying physical model. In this paper, we study haptic rendering and visualization of the generation of waves in shallow water. For applications, it is usually more important to come up with a believable simulation, rather than a physically accurate simulation. Therefore our focus was on obtaining suitable simplifications of the Kas-Miller model, and incorporation into a multimodal environment, aiming at haptic rendering and real-time visualization of waves. The result has been implemented and tested using a Haptic Master device, produced by FCS Control Systems

Maps, agents and dialogue for exploring a virtual world

In previous years we have been involved in several projects in which users (or visitors) had to find their way in information-rich virtual environments. 'Information-rich' means that the users do not know beforehand what is available in the environment, where to go in the environment to find the information and, moreover, users or visitors do not necessarily know exactly what they are looking for. Information-rich means also that the information may change during time. A second visit to the same environment will require different behavior of the visitor in order for him or her to obtain similar information than was available during a previous visit. In this paper we report about two projects and discuss our attempts to generalize from the different approaches and application domains to obtain a library of methods and tools to design and implement intelligent agents that inhabit virtual environments and where the agents support the navigation of the user/visitor

Toward Affective Dialogue Modeling using Partially Observable Markov Decision Processes

We propose a novel approach to developing a dialogue model which is able to take into account some aspects of the user’s emotional state and acts appropriately. The dialogue model uses a Partially Observable Markov Decision Process approach with observations composed of the observed user’s emotional state and action. A simple example of route navigation is explained to clarify our approach and preliminary results & future plans are briefly discussed

An Animation Framework for Continuous Interaction with Reactive Virtual Humans

We present a complete framework for animation of Reactive Virtual Humans that offers a mixed animation paradigm: control of different body parts switches between keyframe animation, procedural animation and physical simulation, depending on the requirements of the moment. This framework implements novel techniques to support real-time continuous interaction. It is demonstrated on our interactive Virtual Conductor

Presenting in Virtual Worlds: An Architecture for a 3D Anthropomorphic Presenter

Multiparty-interaction technology is changing entertainment, education, and training. Deployed examples of such technology include embodied agents and robots that act as a museum guide, a news presenter, a teacher, a receptionist, or someone trying to sell you insurance, homes, or tickets. In all these cases, the embodied agent needs to explain and describe. This article describes the design of a 3D virtual presenter that uses different output channels (including speech and animation of posture, pointing, and involuntary movements) to present and explain. The behavior is scripted and synchronized with a 2D display containing associated text and regions (slides, drawings, and paintings) at which the presenter can point. This article is part of a special issue on interactive entertainment

Speciation in the baboon and its relation to gamma-chain heterogeneity and to the response to induction of HbF by 5-azacytidine

In the baboon (Papio species), the two nonallelic gamma-genes produce gamma-chains that differ at a minimum at residue 75, where isoleucine (I gamma-chain) or valine (V gamma) may be present. This situation obtains in baboons that are sometimes designated as Papio anubis, Papio hamadryas, and Papio papio. However, in Papio cynocephalus, although the I gamma-chains are identical with those in the above mentioned types, the V gamma-chains have the substitutions ala----gly at residue 9 and ala----val at residue 23. The V gamma-chains of P. cynocephalus are called V gamma C to distinguish them from the V gamma A-chains of P. anubis, etc. A single cynocephalus animal has been found to have only normal I gamma-chains and I gamma C-chains (that is, glycine in residue 9, valine in 23, and isoleucine in 75). When HbF is produced in response to stress with 5-azacytidine, P. anubis baboons respond with greater production than do P. cynocephalus, and hybrids fall between. Minimal data on P. hamadryas and P. papio suggest an even lower response than P. cynocephalus. As HbF increases under stress, the ratio of I gamma to V gamma-chains changes from the value in the adult or juvenile baboon toward the ratio in the newborn baboon. However, it does not attain the newborn value. The V gamma A and V gamma C-genes respond differently to stress. In hybrids, the production of V gamma A- chains exceeds that of V gamma C-chains. A controlling factor in cis apparently is present and may be responsible for the species-related extent of total HbF production. It may be concluded that the more primitive the cell in the erythroid maturation series that has been subjected to 5-azacytidine, the more active is the I gamma-gene